Digital image filtering and post-capture processing using user specific data

ABSTRACT

There are provided systems and methods for digital image filtering and post-capture processing using user specific data. A computing device may include a camera that records media of a scene, including images or videos. A user may utilize the computing device to add filters, graphical overlays, or other effects to the recorded media, which may alter pixel data for pixels of the media or blend graphics into the media. When adding image effects to images, the device or a service provider that offers and image hosting and/or sharing platform may determine recommendations for particular image effects to use when recording and processing the image. The recommended effects may be based on effects used in past media, as well as user information, and may change an appearance of the output media in a particular way specific to the user, media, and/or scene.

TECHNICAL FIELD

The present application generally relates to recording and/or processingdigital images and more specifically to utilizing crowd-sourced,location specific, and/or user specific data to filter digital imagesprior to capture and perform post-image processing.

BACKGROUND

Image or other media recording and processing mobile computing deviceshave become widespread and are used nearly daily by many users. As theminiaturization of mobile devices increases and becomes more prevalent,a larger amount of media capture, storage, and processing is performedon-device. However, media hosting, editing, and sharing platforms stillprovide popular online resources for users to interact with other users,share their images or videos, and view other users' media. When sharingmedia, users often look for popular media captured by other users, orattempt to capture something that other users will find interesting. Forexample, trend-setting users may record media that is new andinteresting, and causes a high level of user views, interactions, and/orfollower retention. These types of popular media not only provide anincrease in distribution and consumption of the media by other users,but may also serve to drive financial considerations of the sharinguser, who may receive revenue from sharing highly viewed content.However, the user that wishes to create new and interesting mediacontent is relied upon to determine potentially trending or popularmedia. Devices and media sharing platforms do not provide assistance tothe user in identifying what may be popular and trending, or what fieldof media and/or recorded scenes may be overly saturated. Thus, users mayrecord and process images without identifying advantageous media captureinformation, which may not drive Internet traffic to the media.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a networked system suitable forimplementing the processes described herein, according to an embodiment;

FIG. 2A is an exemplary graphical user interface (GUI) displaying aviewfinder of a camera application recommending particular image effectsfor a scene prior to image capture, according to an embodiment;

FIG. 2B is an exemplary graphical user interface (GUI) displaying animage sharing platform recommending particular image effects forpost-processing of a captured image, according to an embodiment;

FIG. 3 is an exemplary system environment of a communication deviceinteracting with a service provider server to determine and outputrecommendations during image capture and post-image processing,according to an embodiment;

FIG. 4 is a flowchart of an exemplary process for digital imagefiltering and post-capture processing using user specific data,according to an embodiment; and

FIG. 5 is a block diagram of a computer system suitable for implementingone or more components in FIG. 1, according to an embodiment.

Embodiments of the present disclosure and their advantages are bestunderstood by referring to the detailed description that follows. Itshould be appreciated that like reference numerals are used to identifylike elements illustrated in one or more of the figures, whereinshowings therein are for purposes of illustrating embodiments of thepresent disclosure and not for purposes of limiting the same.

DETAILED DESCRIPTION

Provided are methods utilized for digital image filtering andpost-capture processing using user specific data. Systems suitable forpracticing methods of the present disclosure are also provided.

Computing devices may include functionality to capture images or videosusing a camera or other media capture device associated with the device.For example, digital cameras, mobile smart phones, tablet computers,digital video recorders, gaming systems including mobile gaming systems,and other types electronic devices are capable of capturing media of ascene, including images having representations or portrayals of items,objects, persons, or other real-world physical articles. Media data ormedia content captured of a user may correspond to still images, videos,and/or other visual content of a user, and may be referred to as an“image,” “video,” or more generally media. Although the terms “image,”“video,” or the like may be used throughout, it is understood that otherforms of data may also be captured, including infrared image data, x-raydata, or other types of media that may be detected by an imaging device,such as a camera, infrared sensor, photodetector, etc. Media data of auser may be captured during use of the computing device. For example, acamera of a computing device may capture an image or video selected by auser through directing the camera at a scene. The user may view arepresentation of the scene through a viewfinder, which may correspondto an optical viewfinder that allows for passage of light or otherelectromagnetic radiation, where the optical viewfinder is substantiallyis pointed towards the scene and allows for imitation of captured mediaof the scene, and/or through a digital viewfinder that outputs signalsreceived from a digital camera sensor. Thus, in certain embodiments, thecamera may include a device that includes a viewfinder having an outputdisplay that is used with an optical viewfinder and an exposure camerathat uses light sensitive film. In such embodiments, the exposure cameramay include one or more optical lenses or filters displaced prior to thelight sensitive film that alters and adjust incoming light radiationprior to hitting the light sensitive film.

However, in other embodiments, the optical imaging and/or capture deviceassociated with the computing device may correspond to a digital camera,where the digital camera includes one or more lenses to allow passage ofelectromagnetic radiation and an array of photosensitive sensors on asubstrate that detects the electromagnetic radiation and converts thewave/signal for the electromagnetic radiation into one or more digitalvalues that are used to represent the incoming radiation (e.g., incominglight). In such embodiments, the array may include one or more sensorelements that detect the incoming radiation and provide image datacorresponding to pixels as image elements that make up a digitalrepresentation of an image (or many images in the case of a video). Inthis regard, the digital camera may include one or more lenses,radiation or light filters, and/or other optical characteristics thatmay alter or change the incoming electromagnetic radiation prior tobeing detected by the array or other sensor if the device, for example,by filtering certain wavelengths. The digital camera may also includeone or more post-processing image processing techniques, which mayadjust pixel value within a captured image (or series of images, such asa video), add graphical objects or blend images, and/or otherwise changea captured image. The digital camera may be included in a mobilecomputing device, such as a traditional direction digital camera of amobile device, a forward facing camera of the mobile device, and/or acamera with a tablet computer or personal computer, or may correspond toa digital camera independent of another computing device. The camera maybe capable of capturing data of a scene that the camera is pointed at,which may be in a traditional camera direction or mounted in such aposition to capture the user using the device, such as a “selfie” orpersonal picture of a user captured with a forward facing camera of amobile phone.

Thus, a user may utilize the camera to capture an image of a scene. Theuser's device including or associated with the camera may record or takemedia capture data, which may correspond to recorded media data, forexample, an image or video after a user selects a button or process torecord incoming electromagnetic radiation of a scene, or may correspondto pre-capture data displayed in or recorded by a viewfinder, such as adisplay of incoming electromagnetic radiation output in an interface ofa display screen component of a digital camera. For example, the images,videos, or other media data may be stored to the device from media datathat has been previously captured (e.g., in an image library) or may beavailable from data retrieved or accessible through an online resource,including social networking platforms, media sharing resources, and/oremail/messaging services. Media data stored to a computing device mayinclude a library of images/videos or data stored to and/or accessibleby one or more applications on the device. Conversely, pre-recordedmedia capture data may correspond to data being actively output anddisplayed by the device prior to recording of the media data (e.g.,recording of the incoming electromagnetic radiation of the scene), andmay be processed as the data is incoming to the device and/or streamed(e.g., in real-time) to a service provider for processing.

Media data may therefore include a representation or portrayal of ascene, including objects in the scene. Media data, such as a still imageor video, may also include a representation, portrayal, or likeness ofone or more users, such as facial data and/or body data of the user(s).Additionally, in other embodiments, audio data, or audiovisual data, mayalso be captured that includes audio data of the scene and/or theuser(s). Thus, as discussed herein, the media capture data maycorrespond to a single image, or may be a plurality of images, such as avideo having multiple frames or still images, and may be recorded or maybe displayed in an interface or viewfinder for recording. The additionalmedia capture information may include sounds and voice cues, backgroundor ambient noise, biometrics (e.g., fingerprint, heart rate, retinalscan), geo-location(s) (e.g., detected by a GPS component of the deviceat the time of the media capture data), and/or other data or metadatathat may attach to an image, a video, or displayed media capture dataprior to recording. Such additional information may be captured by acommunication device, such as a mobile phone, or a connected device,such as a wearable communication device.

An application on the computing device may display the media capturedata, which may be displayed in an interface corresponding to aviewfinder and/or a media capture application (e.g., camera roll orlibrary of stored images). In other embodiments, the media capture datamay be displayed from media stored to an online resource and/or serviceprovider, which may be uploaded by the computing device or anotherdevice, and may be downloaded and displayed in one or more applicationsexecuting on the device, such as a web browser application or adedicated application of the resource/service provider. In otherembodiments, the application may instead be one or more subroutines inone or more libraries shared between multiple applications that may beexecuted by the application when viewing media data and content and/orattempting to capture new media data. The media capture data may beprocessed by the computing device to determine any potential filters,graphics, or other effects to apply to the media capture data prior torecording of media content, which may then result in media contenthaving the effect. In such embodiments, the media capture data may beprocessed directly by the computing device on detection of the mediacapture data by the camera or viewfinder, for example, as a digitalcamera detects the incoming electromagnetic radiation on a substratehaving the array of sensor, or may be streamed to a service provider forprocessing. However, in other embodiments where the media capture datamay correspond to a recorded or captured image (or video), which may bestored to the computing device and/or uploaded by the computing deviceto an online resource/service provider, the media capture data may beretrieved by the computing device and processed by the computing deviceor service provider.

The media capture data may be processed to determine a recommendationfor a filter, effect, and/or graphic to be applied to media capture data(e.g., prior to recording of the associated media content/data orpost-processing with previous recorded media content/data). An effectmay correspond to some imaging technique that may change or alterrecorded media. Thus, the effect may correspond to a pre-capture effectapplied to incoming electromagnetic radiation that alters the receptionof the radiation, or a post-capture processing that adds or changes anappearance of captured data. In order to determine the recommendation,the application processing the incoming media capture data may utilizeone or more other images or videos, including media captured by the userand/or other users, to determine a recommendation for an effect to applyto the media capture data. The other media data may include one or moreeffects used on or with the media data, as well as other associatedmetadata including user name, identifiers, hashtags, a location, and/oridentified content in the media. In certain embodiments, the applicationmay utilize popularity and/or trending ratings to determine what effectis being used in media, and how often the effect is being used. Forexample, one or more effects may be used in previously captured andrecorded media by the user associated with the computing device and/orother users.

A popularity rating or trending rating may be associated with eachindividual effect, and may correspond to a numerical value, such as anumber of times the effect is used. The rating may be weighed by time sothat more recent uses are given more weight in the score or value. Inother embodiments, the popularity or trending rating may also weighcertain sharing users of the media data more heavily, such as users withlarge followers, many media shares, large libraries, and/or famous/trendsetting users (e.g., celebrities, artists, photographers, etc.). Thus, apopularity rating or a trending rating may correspond to a score, value,or other quantifier for a media effect that indicates a parameter ofusage of the media effect by other users and/or in other media content.In one example, a rating may be high for an effect, such as a sepia tonefilter or steam graphical overlays, that is used by many users, where asa low rating or a new and unused rating may be applied to effects notoften used or unused, including new effects provided by newapplications/processes or application/process updates.

The rating may be dependent on the followers and/or followedaccounts/users by the user capturing the media capture data, forexample, by determining the rating using those accounts/users andlimiting the rating calculation to only those accounts/users ofimportance to the user. The rating may also be dependent on a number ofunique uses, for example, in different media and/or by different users.Thus, the usage of one or more effects may be determined across a rangeof users and/or media and may be crowd-sourced using the varioususers/accounts using the media capture or post-processing effect(s).Multiple ratings may be determined for multiple available media effects,including a portion or all of the media effects available to thecomputing device and/or service provider for use with the media capturedata. Thus, determination and/or retrieval of the ratings may be limitedto those effects available to the computing device/service provider.

In various embodiments, the rating may be determined by mining one ormore media sharing feeds, posts, or timelines to extract data used todetermine the popularity or trending rating of one or more effects inimages. For example, the rating may be based on likes, comments, shares,mentions, and/or follows with respect to particular media data includingthe effect. The rating be determined using additional data thatdetermines a popularity or trend of use of the effect with mediacontent. The rating may also be scene and/or media specific, so that therating is particular to the media capture data for the user. Forexample, the media capture data may be processed using image recognitionto identify one or more of a user, a location, an environment, and/or anobject in the media capture data. Search for popularity ratings ortrending ratings for effects may be limited to media data having thesame or similar user(s), location(s), environment(s), and/or object(s).For example, media capture data having an image of a coffee cup at acoffee shop may be used to search for effects that are used on the samecoffee cup or at the same coffee shop, or with similar media content ofcoffee cups and coffee shops. Thus, metadata for the image capture datamay also be used to search for and/or determine effects and theircorresponding popularity/trending ratings, where the effects may be usedwith the image capture data.

Once one or more effects are determined for the image capture data usingimage effects used in past or previously captured media, arecommendation for the effects may be determined by theapplication/processes executed by the computing device or serviceprovider. The recommendation may recommend or suggest at least one ofthe effects for use with the media data based on the rating of theeffect crowd-sourced from the other users, accounts, and media shared onthe service provider and/or based on effects previously used by the userwith other media. For example, the recommendation may be for a commonlyor often used effect based on the data from the other images where theeffect may inform the user of popular, trending, or past used effects.Conversely, if the recommendation is for new and unique effects, therecommendation may be for an effect that is not widely used, popular, ortrending, which may provide the user with a unique effect to use withthe media capture data. In various embodiments, the recommendation maybe determined based on a likelihood of conversion of browsing users of astream of media content into viewers of the media capture data and/or offollowers of the user and/or user's account recording the media capturedata. Thus, a recommendation may be to provide the user with one or morepopular or trending effects, or may inform the user of new and uniqueeffects. Multiple recommendations may be determined so that therecommendations may be displayed with their corresponding differenteffects, and the user may choose an effect based on the recommendationthat matches their needs or interests.

In various embodiments, the recommendation may be determined usingnearby devices to the computing device recording and/or processing themedia capture data, or nearby a location of the media capture data(e.g., when the media capture data correspond to an image or videocaptured at some time in the past). The nearby devices may havecorresponding media content generation for the same or similar scene asthe media capture data. Additionally, the nearby devices may utilize aneffect with the generated media content, such as a filter, graphicaloverly, or blending with a stored graphic. The media effect data for theeffects used by the nearby devices may be provided to the computingdevice or service provider for determination of the recommended effect,which may then be location-specific to the location of the media capturedata and/or a predetermined or set proximity range or area around thelocation. The media capture data may be processed to determine thelocation, for example, using object/user recognition in the image and/ormetadata of the image. Thus, the effect recommendation may be determinedusing content within the media capture data of the scene, including anymetadata associated with capture/recording of an image or video. Forexample, a location (e.g., GPS coordinates, check-in location, networkor IP address associated with a fixed location device, etc.) of themedia capture data may be provided with the media capture data, or maybe determined using the media capture data. The nearby devices to thecomputing device may be identified using the geo-location of thecomputing. In other embodiments, the computing device may communicatewith nearby devices using device-to-device communications, which may beused to receive media content from the other devices and/or effectinformation for media effects used by the other devices with mediacontent. The device-to-device communications may include communicationsover a shared network access point, such as a WiFi router, or based onshort range wireless communications (e.g., Bluetooth, BLE, LTE Direct,WiFi, NFC, etc.) communications between the devices. Thus, the effectsused in media content of the same or similar scene and/or at the same orsimilar location may be crowd-sourced across nearby devices and theirrecorded media content, which may be temporally related to the time ofrecording of the media capture data. The recommended effect may then bedetermined based on the same or similar effect used by the other nearbydevices, or may correspond to a new or unique effect not used, rarelyused, or not recently used by the nearby devices.

Additionally, the effect recommendation may be determined based on otherdata. User preferences and/or information may be used to determine theeffect recommendation, which may or may not be used with theaforementioned information. In this regard, user preference may indicatewhether the user would prefer trending or popular effect recommendation,or would prefer new and unique effects not used, rarely used, or notrecently used by other users in media data, including the same orsimilar media data. Other user preferences may be to match effects tocertain users and/or media (e.g., trending users, friends, family,social networking connections, and/or popular users), weights used todetermine a popularity rating, and/or weights for particular types ofeffects. The user information may also correspond to an experience levelor rating of the user with use of effects for media data, including theuser's experience with using the device application forcapture/processing of media data and/or the online service provider. Forexample, a user that is not experienced in using the application/serviceprovider to edit media data may wish to see popular effects that otherusers like as an entrance or gateway to learning media editing andeffect use. Conversely, an experienced user may wish to view new andunique effects as it may be assumed that the experienced user can searchfor, use, and view the popular media effects. The experience level mayalso indicate a length of instruction output with the recommendation foruse of the media editing effect. In various embodiments, the userinformation may also include information on past usage of media editingeffects, including those effects used in previously captured images bythe user. Thus, the recommendation may be for a media effect thatmatches or is associated with the past used media effects, for example,to make a portfolio of captured media stylistically coherent andsimilar.

The recommendation may be output in a user interface with theinstructions. In various embodiments, the recommendation may be outputwith an interface alert element that tags or highlights the effectrecommended with the recommendation, for example, a highlight of theeffect in the interface. The recommendation may include data that causedgeneration of the recommendation, such as the popularity of the effect,number of uses, past uses, and/or similar media data. The recommendationmay be displayed with the media capture data in an interface of thecomputing device, such as a viewfinder interface displaying pre-capturedata of a scene or an interface of an application accessing previouslycaptured data for display and editing by the user. The effectrecommendation may be generated as a notification that includes textand/or audio instructions. The instructions may assist the user in howto use or apply the effect, and may provide areas within the mediacapture data for application of the effect. The recommendation may alsoallow the user to view sample media data using the effect.

In various embodiments, the recommendation may also or instead include arecommendation for a hashtag identifier, title, or description to beused with the media capture data. The hashtag identifier may correspondto an identifier used to link the media capture data to a group of thesame or similar media data, or may correspond to a new and/or uniquehashtag identifier to separate the media capture data from a group amedia data. The hashtag identifier, title, or description may bedetermined similar to determination of the effect, as discussed herein.Other recommended data may include instructions of how or where tocapture data, which may be synchronized to be the same or similar toother media data of the scene, or may guide the user of other content tocapture from the scene that is not the same or similar to other mediadata of the scene. Such instructions may be output as directionalindicators, text, and/or audio. The instructions may also be output asan augmented reality that blurs, highlights, or otherwise shows thatcontent to capture from the scene in a viewfinder interface displayingthe media content data. The recommendation may display the additionaldata with the media capture data in the application interface on thecomputing device.

In various embodiments, the media effect recommendation and/or imageprocessing may occur after recording the media, for example, once animage or video is stored to the user's device or uploaded to an imagehosting, editing, and/or sharing platform, such as an online resource.As previously discussed, the media capture data may correspond to storeddata on the computing device or with another entity, such as anotherdevice, a networked server, or a cloud computing architecture of anonline resource. Thus, the media capture data may correspond to actualcaptured and recorded media, such as a stored and/or uploaded image orvideo. The service provider may therefore correspond to an imagehosting, sharing, and/or editing platform allowing the user to accessthe platform using the computing device and perform editing of thestored media content as discussed herein.

After processing the media capture data with the effect, the user mayview the altered or changed media capture data. The user may furtherchange the effect if desired, and may request a new recommendation,which may be determined by omitting the previous recommended effect anddetermining a new recommended effect as discussed herein. Once the useris satisfied with the effect, the user may capture media data having theeffect or may edit the previously captured data with the effect. The newmedia data having content that is edited and changed using the effectmay then be stored to the device and/or uploaded to the serviceprovider. The service provider may use the media data with the effect todetermine recommendations for one or more other devices and/or users.

Thus, using the processes described herein, image (or any media) editingmay be improved by providing contextual relevant and useful imageeffects and processing. Such editing processes allow users to adjust thecontent and output of media data, and create new and interesting mediadata. By improving editing tool use, display, and user interfaceintegration, users may more easily edit media data and generate content,which may provide time savings over traditional methods of media editingand content generation. Moreover, utilizing the processes providedherein, devices and online service providers may provide solutions touser integration with media capture and/or editing systems, which mayassist in onboarding users to new applications and processes, andretainer users. This may further assist in driving traffic both to theapplication/service provider, and to particular shared media on anonline platform. Such processes therefore improve image captureprocesses and post-capture processing, or more generally any mediaprocessing, by providing image editing tools and processes usingcontextual data.

FIG. 1 is a block diagram of a networked system 100 suitable forimplementing the processes described herein, according to an embodiment.As shown, system 100 may comprise or implement a plurality of devices,servers, and/or software components that operate to perform variousmethodologies in accordance with the described embodiments. Exemplarydevices and servers may include device, stand-alone, andenterprise-class servers, operating an OS such as a MICROSOFT® OS, aUNIX® OS, a LINUX® OS, or other suitable device and/or server based OS.It can be appreciated that the devices and/or servers illustrated inFIG. 1 may be deployed in other ways and that the operations performedand/or the services provided by such devices and/or servers may becombined or separated for a given embodiment and may be performed by agreater number or fewer number of devices and/or servers. One or moredevices and/or servers may be operated and/or maintained by the same ordifferent entities.

System 100 includes a communication device 110 and a service providerserver 140 in communication over a network 150. The user (not shown) mayutilize communication device 110 to utilize the various featuresavailable for communication device 110, which may include processesand/or applications executed by communication device 110 for captureand/or editing of media with one or more media effects that change anappearance or output of the media. Communication device 110 may includecomponents to capture media data, such as images, videos, or otheraudio, visual, or audiovisual content, of a user when the user usescommunication device 110. Communication device 110 may providerecommendations for media effects to user with captured media data,which may be determined by communication device 110 and/or serviceprovider server 140. After editing media data, the media data may bestored to communication device 110, uploaded to service provider server140 for hosting and/or sharing on an online platform, and provided toanother device.

Communication device 110 and service provider server 140 may eachinclude one or more processors, memories, and other appropriatecomponents for executing instructions such as program code and/or datastored on one or more computer readable mediums to implement the variousapplications, data, and steps described herein. For example, suchinstructions may be stored in one or more computer readable media suchas memories or data storage devices internal and/or external to variouscomponents of system 100, and/or accessible over network 150.

Communication device 110 may be implemented as a communication devicethat may utilize appropriate hardware and software configured for wiredand/or wireless communication with service provider server 140. Forexample, in one embodiment, communication device 110 may be implementedas a personal computer (PC), telephonic device, a smart phone,laptop/tablet computer, wristwatch with appropriate computer hardwareresources, eyeglasses with appropriate computer hardware (e.g. GOOGLEGLASS ®), other type of wearable computing device, and/or other types ofcomputing devices capable of transmitting and/or receiving data.Communication device 110 may include or be associated with a camera 120,which may be physical contained, embedded, attached to, or included withcommunication device 110. In certain embodiments, camera 120 may beexternal to communication device 110 and provide input data tocommunication device 110 (e.g., through a wired connection or wirelessconnection over short range wireless communications or a network).Although only one communication device is shown, a plurality ofcommunication devices may function similarly.

Communication device 110 of FIG. 1 contains camera 120, an imageprocessing application 130, an image sharing application 112, otherapplications 114, a database 116, and a communication module 118. Imageprocessing application 130, image sharing application 112, and otherapplications 114 may correspond to executable processes, procedures,and/or applications with associated hardware. In other embodiments,communication device 110 may include additional or different moduleshaving specialized hardware and/or software as required.

Camera 120 corresponds to an optical device of communication device 110enabling a user associated with communication device 110 to capture orrecord images, including still and/or video images. Camera 120 maycorrespond to a digital camera on communication device 110 (e.g.,incorporated in communication device 110 such as a mobile phone'sdigital camera in a traditional camera orientation and/or a forwardfacing camera orientation that captures one or more users as they useand view a display screen of communication device 110) or associatedwith communication device 110 (e.g., connected to communication device110 but incorporated within a body or structure of communication device110), or may more generally correspond to any device capable ofcapturing or recording an image, video, or other digital media data,including infrared imaging or other types imaging devices. As a digitalcamera, camera 120 may include a sensor array disposed on asemiconductor substrate having a plurality of photosensitive elementsconfigured to detect incoming light. In other embodiments, other typesof electromagnetic radiation sensors may be used, including infraredsensitive sensors/elements and the like. In other embodiments, camera120 may correspond to a traditional exposure camera, which may include alens and shudder to allow incoming electromagnetic radiation to berecorded on light sensitive film. In such embodiments, camera 120 mayutilize communication device 110 to receive recommendations on effects,such as filters, lens, and/or zoom, to apply to incoming light prior tobeing recorded on photo sensitive film.

Camera 120 may include various features, such as zoom, flash, focuscorrection, shutter speed controls, or other various features usable tocapture one or more images or videos of the user and/or other users orobjects. Camera 120 may include other media capture components,including a microphone to capture audio data and/or a touch element orscreen that captures a biometric. Camera 120 may further display apreview and/or captured image to the user through another device ofcommunication device 110, such as a viewfinder, screen (e.g., mobilephone touch screen, tablet touch screen, and/or personal computermonitor), or other display. Camera 120 may interface with one or moreapplications of communication device 110 to capture media data, such asimages/videos, which may be used to determine one or more effects toapply prior to recording media data and/or perform post-processing ofrecorded media. Camera 120 may also be used to capture media data thatis processed to determine reference data points or nodes for use infuture facial recognition processes. Image processing application 130may therefore use camera 120 to capture media data, which may beprocessed to determine reference media data for facial recognitionprocesses of image processing application 130, or may be processed withreference media data to determine an identity of a user.

Image processing application 130 may include one or more processes toutilize devices of communication device 110 to receive media data fromcamera 120 and capture media data, including applying effect prior to orduring the recording of media data, and/or process recorded media to addimage effects. In this regard, image processing application 130 maycorrespond to specialized hardware and/or software utilized bycommunication device 110 to first receive media data from camera 120,which may include one or more images or videos. The media data maycorrespond pre-recorded data being currently detected by camera 120, ormay correspond to recently captured media content, such as an image ofvideo that was captured by communication device 110 using camera 120 anddisplayed in response to the recording of the media. In otherembodiments, the media data may be accessed from stored media data, forexample, media data stored to database 116 and/or service providerserver 140. Image processing application 130 may display the media datain a viewfinder, a post-recording interface, and/or a video library. Themedia data may also be displayed with controls for recording the mediadata, deleting the media data, storing the media data to one or moredatabases including database 116 and/or database 146, uploading ordownloading the media data, and/or adding an effect to the media data,including zoom controls, lens filters, color filters, graphicaloverlays, graphic blending and/or addition, or other effect.

In this regard, once the media data is received, image processingapplication 130 may process the media data to determine one or morerecommendations on use of an effect in the media data. In otherembodiments, the media data may be provided to service provider server140 for determination of the recommendation and/or to receive past mediaeffect data for effects used in media data having the same or similarcontent. Thus, one or more of the processes discussed herein that areperformed by image processing application 130 may also or instead beperformed by service provider server 140. In order to determine arecommendation, the past image effect data may be used to determineeffects used in other media, and provide a recommendation for one ormore effects. The recommendation may be for a popular or commonly usedeffect, or for a unique, not recently used, or new effect. Thus,multiple recommendations may be determined in certain embodiments, whereeach recommendation is for a different effect and based on a differenttriggering condition or data to cause the recommendation.

Moreover, the recommendation(s) for one or more effects may be made moreparticular to the media data processed by image processing application130 using additional data. The recommendation may be determined acurrent location detected by communication device 110 (e.g., GPSdata/coordinates) at the time of the media data, and may be used todetermine nearby devices and media data captured by those devices.Effects used by the nearby devices in their respective recorded mediamay be received by image processing application 130 using localconnection with the nearby devices, for example, throughdevice-to-device communications including using short range wirelesscommunications, or may be received from service provider server 140based on the detected geo-location. The content of the media data mayalso be used to search for the same or similar media data previouslycaptured by other users and/or devices, and effects used in such mediadata. Additionally, user preferences and user information may be used todetermine one or more effect for particular media data, including pasteffects used by the user, user experience in adding effect and/or usingimage processing application 130, preferences for effect searching byother users and/or media, and/or connections of the user with otheronline users sharing media.

Once the recommendation is determined and/or received by imageprocessing application 130, the recommendation may be output by imageprocessing application 130 in an interface associated with the mediadata. The recommendation may highlight or indicate the recommendedeffect, and may include a notification or alert of the effect. Therecommendation may be output as text, images, and/or audio in theinterface, and may be provided with the media data to allow the user toapply the effect and see changes to the media data in the interface. Ifthe user selects to keep the effect, the media data may be recorded oredited with the effect, and may be stored to database 116 and/oruploaded to service provider server 140. Where the media data is notlocal to communication device 110, for example, when residing on serviceprovider server 140 and edited using image processing application 130accessing service provider server 140, the media data may be requestedto be updated, edited, and/or stored with service provider server 140,as well as downloaded by communication device 110. The user may alsoutilize image processing application 130 to further edit the media data,for example, by adding further effects, which may also be recommended asdiscussed herein, or by removing effects using one or more processes toremove effect data from the image and restore the image to the initialpresentation.

Image sharing application 112 may correspond to one or more processes toexecute software modules and associated components of communicationdevice 110 to provide one or more features associated with serviceprovider server 140, including sharing of media content by uploadingstored media content, and viewing of other shared media content. In thisregard, image sharing application 112 may correspond to specializedhardware and/or software utilized by communication device 110 to providemessaging, social networking, media sharing or viewing, imaging,microblogging, web browsing applications, and/or other types of service.Image sharing application 112 may allow a user to utilize communicationdevice 110 to upload media data stored to database 116, including mediadata recorded or edited with an effect, to service provider server 140.Additionally, image sharing application 112 may allow a user to browsethrough media data recorded by other users, as well as view effects usedby other users in the media data. Image sharing application 112 may beused to access past effect usage data for one or more other mediacontents, including other recorded images or videos, which may be usedto determine recommendations for effect usage in media data recordedand/or edited using image processing application 130.

One or more of the aforementioned features and/or processes of imageprocessing application 130 may be included within image sharingapplication 112 or vice versa, for example, to provide their respectivefeatures within one application and/or application interface.

In various embodiments, communication device 110 includes otherapplications 114 as may be desired in particular embodiments to providefeatures to communication device 110. For example, other applications114 may include security applications for implementing client-sidesecurity features, programmatic client applications for interfacing withappropriate application programming interfaces (APIs) over network 150,or other types of applications. Other applications 114 may also includeemail, texting, voice and IM applications that allow a user to send andreceive emails, calls, texts, and other notifications through network150. In various embodiments, other application 114 may includeapplications, processes, and/or subroutines used for device-to-devicecommunications with other nearby devices, including through short rangecommunication protocol (e.g., Bluetooth, Bluetooth Low Energy, WiFi, LTEDirect, near field communications, radio, etc.), or through accessing ashared network access point, such as a WiFi router, local to an area andcommunicating through the shared access point.

Other applications 114 may include financial applications, such asbanking, transaction processing, and/or payment applications. Otherapplications 114 may also include location detection applications, whichmay be used to determine a location for the user, such as a mapping,compass, and/or GPS application, which can include a specialized GPSreceiver that obtains location information for communication device 110and processes the location information to determine a location ofcommunication device 110 and the associated user. Other applications mayinclude merchant applications used for one or more purchases, which mayinterface and/or include financial applications/processes. Otherapplications 114 may include device interfaces and other display modulesthat may receive input from the user and/or output information to theuser. For example, other applications 114 may contain software programs,executable by a processor, including a graphical user interface (GUI)configured to provide an interface to the user. Other applications 114may therefore use devices of communication device 110 capable ofconveying information to users.

Communication device 110 may further include database 116 stored to atransitory and/or non-transitory memory of communication device 110,which may store various applications and data and be utilized duringexecution of various modules of communication device 110. Thus, database116 may include, for example, identifiers such as operating systemregistry entries, cookies associated with image sharing application 112and/or other applications 114, identifiers associated with hardware ofcommunication device 110, or other appropriate identifiers, such asidentifiers used for payment/user/device authentication oridentification, which may be communicated as identifying communicationdevice 110 to service provider server 140. Database 116 may include dataused by image processing application 130 to add effects to media data,including data for available effects. Such data may correspond to asoftware routine that adds an effect, changes an appearance, orotherwise alters media data, or may correspond to data necessary to addan effect to media data, such as information for use and/or manipulationof one or more physical lenses or filters. Additionally, recommendationsfor use of effects determined by one or more of image processingapplication 130 and/or service provider server 140 may be stored todatabase 116 prior to and/or after output, which may then be used byimage processing application 130 during execution. Where applicable,media data may be stored to database 116, for example, in a library ofavailable media data.

Communication device 110 includes at least one communication module 118adapted to communicate with service provider server 140. In variousembodiments, communication module 118 may include a DSL (e.g., DigitalSubscriber Line) modem, a PSTN (Public Switched Telephone Network)modem, an Ethernet device, a broadband device, a satellite device and/orvarious other types of wired and/or wireless network communicationdevices including microwave, radio frequency, infrared, Bluetooth, andnear field communication devices. Communication module 118 maycommunicate directly with nearby devices using short rangecommunications, such as Bluetooth Low Energy, LTE Direct, WiFi, radiofrequency, infrared, Bluetooth, and near field communications.

Service provider server 140 may be maintained, for example, by an onlineservice provider, which may provide one or more services to users. Inthis regard, service provider server 140 includes one or more processingapplications which may be configured to interact with communicationdevice 110 and/or another device/server to provide a platform to storemedia data, host the media data for viewing and/or retrieval, share themedia data, and/or edit the media data using one or more effects. In oneexample, service provider server 140 may be provided by PAYPAL®, Inc. ofSan Jose, Calif., USA. However, in other embodiments, service providerserver 140 may be maintained by or include another type of serviceprovider.

Service provider server 140 of FIG. 1 includes an image sharing platform142, other applications 154, a database 156, and a network interfacecomponent 158. Image sharing platform 142 and other applications 154 maycorrespond to executable processes, procedures, and/or applications withassociated hardware. In other embodiments, service provider server 140may include additional or different modules having specialized hardwareand/or software as required.

Image sharing platform 142 may correspond to one or more processes toexecute software modules and associated specialized hardware of serviceprovider server 140 to provide a service to the user associated withcommunication device 110, which may include a service used for storing,hosting, sharing, and/or editing media data, such as images or movies.In this regard, image sharing platform 142 may correspond to specializedhardware and/or software to provide one or more services associated withmessaging, social networking, media sharing or viewing, microblogging,web browsing, and/or other types of service that may provide mediacontent use services. In various embodiments, image sharing platform 142may provide one or more of the processes discussed in reference to imageprocessing application 130 of communication device 110. In this regard,communication device 110 may access image sharing platform 142 prior tocapturing media data, for example, when attempting to capture media datapresented in a viewfinder, or after capture of the media data. Imagesharing platform 142 may then be used to transmit recommendations foreffects used in image capture and/or editing to communication device110, or to transmit data used for determination of the recommendationsby communication device 110. For example, in some embodiments, imagesharing platform 142 may determine a recommendation for an effect asdiscussed in reference to image processing application 130, for example,using media data and previously recorded media data having one or moreeffects. In other embodiments, image sharing platform 142 may provideinformation for previously recorded media data having one or moreeffects, or data on effects used in the previously recorded media data,to communication device 110 for processing.

Image sharing platform 142 may therefore provide an online portal and/orplatform, such as an image sharing website and/or data for use with adedicated application associated with image sharing platform 142. Theonline website/data may be used to allow communication device 110 toaccess image sharing platform, upload image data, and/or access forviewing/output image data stored to database 146. The user associatedwith communication device 110 may then utilize one or more editingtools, including additional of effects, to edit previously capturedmedia data. The editing may add or remove an effect, where arecommendation for an effect used to edit media data may be determinedas discussed in reference to image processing application 130. Onceedited, the media data may be stored to database 146 and/or downloadedby communication device 110. Image sharing platform may further make themedia data available for viewing by other users, including the public orto connections associated with an account storing and presenting themedia data on image sharing platform 142. Image sharing platform 142 mayfurther utilize previously captured and past media data available indatabase 146 and/or posted to the online portal/platform for viewing todetermine recommendations of effects to apply to media data, includinginformation for past used effects in the media data, or may provide theinformation to communication device 110 for processing. Image sharingplatform 142 may also correspond to a server side transaction processingand/or payment application, which may interact with communication device110, one or more accounts in database 156, and/or another entity'sdevice or server to facilitate processing a transaction and/or making apayment or a transfer. Image sharing platform 142 may receivetransaction processing data for the payment/transfer from communicationdevice 110, where the transaction may be processed for one or moreservices provided by image sharing platform, including image storageand/or editing services. Image sharing platform 142 may also receiveimage data, as well as associated metadata, from communication device110 for storage, which may be stored to database 146 and/or hosted onone or more online platforms for retrieval and viewing by other devices,including communication device 110.

In various embodiments, service provider server 140 includes otherapplications 154 as may be desired in particular embodiments to providefeatures to service provider server 140. For example, other applications154 may include security applications for implementing server-sidesecurity features, programmatic client applications for interfacing withappropriate application programming interfaces (APIs) over network 150,or other types of applications. Other applications 154 may containsoftware programs, executable by a processor, including a graphical userinterface (GUI), configured to provide an interface to the user whenaccessing service provider server 140, where the user or other users mayinteract with the GUI to more easily view and communicate information.In various embodiments, other applications 154 may include connectionand/or communication applications, which may be utilized to communicateinformation to over network 150.

Additionally, service provider server 140 includes database 156. Accountand/or user data may be stored in database 156, which may include userinformation, such as name, address, birthdate, paymentinstruments/funding sources, additional user financial information, userpreferences, and/or other desired user data. Users may link to theirrespective data through an account, user, merchant, and/or deviceidentifier. Thus, when an identifier is transmitted to service providerserver 140, e.g., from communication device 110, user data may be found.Database 156 may also store media data, as well as effects and otherediting tools for media data, which may be stored to an account and/orlibrary associated with an account. Thus, the accounts in database 156may be used to store, host, share, and/or edit media data throughcommunication device 110.

In various embodiments, service provider server 140 includes at leastone network interface component 158 adapted to communicate communicationdevice 110 over network 150. In various embodiments, network interfacecomponent 158 may comprise a DSL (e.g., Digital Subscriber Line) modem,a PSTN (Public Switched Telephone Network) modem, an Ethernet device, abroadband device, a satellite device and/or various other types of wiredand/or wireless network communication devices including microwave, radiofrequency (RF), and infrared (IR) communication devices.

Network 150 may be implemented as a single network or a combination ofmultiple networks. For example, in various embodiments, network 150 mayinclude the Internet or one or more intranets, landline networks,wireless networks, and/or other appropriate types of networks. Thus,network 150 may correspond to small scale communication networks, suchas a private or local area network, or a larger scale network, such as awide area network or the Internet, accessible by the various componentsof system 100.

FIG. 2A is an exemplary graphical user interface (GUI) displaying aviewfinder of a camera application recommending particular image effectsfor a scene prior to image capture, according to an embodiment.Environment 200 a of FIG. 2A includes an interface 1000 that may bedisplayed on a communication device, such as communication device 110 insystem 100 of FIG. 1, where interface 1000 displays media data, such asa digital image, through interface 1000 prior to the media data beingrecorded, for example, when the incoming electromagnetic radiation froma scene is captured using a sensor array of a digital camera prior torecording signals and data for the incoming radiation to a memory. Inthis regard, interface 1000 may be output using those features andprocesses provided by one or more of image processing application 130and/or image sharing application 112 of communication device 110 insystem 100 of FIG. 1.

In interface 1000, a viewfinder 1002 is shown as an interface output ofincoming data and information captured by a camera, such as a portion ofinterface 1000 outputting data for detected signals from a sensor arrayof a digital camera. Thus, viewfinder 1002 may be updated with data forscene 1004 as a user utilizing the device displaying interface 1000points a camera for the device at scene 1004. Viewfinder 1002 maytherefore provide a display of scene 1004 as the potential media datafor recording of scene 1004. Scene 1004 is shown with a graphicaladdition 1006, which may correspond to a stored or available graphicthat is added to, placed within, and blended with scene 1004 in the datashown in viewfinder 1002. Thus, graphical addition 1006 may be recordedwith the data for scene 1004 when the user elects to record scene 1004shown in viewfinder 1002. Graphical addition 1006 therefore correspondsto an effect that can be added to scene 1004 based on a user request oraddition using interface 1000 and viewfinder 1002.

In order to determine one or more effects to add to scene 1004,interface 1000 may output recommendations for effects. In this regard,interface 1000 includes an effect 1008 a, an effect 1008 b, and effect1008 c, and an effect 1008 d. Each of effects 1008 a-d corresponds to adifferent media capture or editing effect that alters an appearance ofscene 1004 when recording the data for scene 1004 in viewfinder 1002,for example, graphical addition 1006 that has already been added toscene 1004 when capturing the data in viewfinder 1002. Interface 1000may recommend an effect of effects 1008 a-d based on various data,including past used effects, data for scene 1004, a location of scene1004 and/or the device displaying interface 1000, device-to-devicecommunications with other nearby devices that also capture scene 1004using a media recording device, and/or past media data having one ormore effects. As shown in environment 200 a, effect 1008 a receivedrecommendation 1010 that highlights effect 1008 a as the effect that theuser should use. Recommendation 1010 may be based on a popular, trending(e.g., increase in use over time), or commonly used effect, or may bebased on a new, not recently used, or unique effect. By selecting effect1008 a in interface 1000, effect 1008 a may be added to scene 1004 inviewfinder 1002.

Additionally, interface 1000 may display other recommended information.For example, a camera direction recommendation 1012 a may also beprovided based on past captured media data, nearby device communicationswith devices also capturing media data of scene 1004, and/or userinformation. Camera direction recommendation 1012 a indicates that theuser viewing scene 1004 should move thirty degrees left to capture mediadata, which is shown as an indicator 1012 b in viewfinder 1002. Cameradirection recommendation 1012 a may be provided so that the user maycapture commonly recorded scenes or media data in past media data or bythe nearby devices, or so that the user may capture new and uniquescenes not captured in previous media data and/or by nearby devices.Interface 1000 may also allow the user to browse past media 1014, whichmay include an past image 1016 a or a past image 1016 b, as well as alibrary 1016 c. Past media 1014 may also be used to determine effectsused by the user in past media 1014 for use in recommendation 1010.

FIG. 2B is an exemplary graphical user interface (GUI) displaying animage sharing platform recommending particular image effects forpost-processing of a captured image, according to an embodiment. Incontrast to FIG. 2A, environment 200 b of FIG. 2B may be displayed on acommunication device, such as communication device 110 in system 100 ofFIG. 1, after recording media data, for example, when accessing anonline service provider, such as service provider 140 in system 100 ofFIG. 1, to view and edit media data including adding one or more effectsto captured media data available with the service provider. In thisregard, interface 1000 may be output using those features and processesprovided by one or more of image processing application 130 and/or imagesharing application 112 of communication device 110 and/or image sharingplatform 142 of service provider server 140 in system 100 of FIG. 1.

In interface 1100, the device displaying interface 1100 may receive datareceived from the online media platform of the service provider, whichmay be output in interface 1100. For example, interface 1100 includesdata for platform X 1102 accessed by the device to retrieve and displaymedia data stored to the service provider, which may be account specificfor an account logged in as user A 1104. In other embodiments, theservice provider may not be necessary, and platform X 1102 maycorrespond to an on-device application for editing media and addingeffects executed by the device displaying interface 1100. Interface 1100may display an image 1106 stored to the account for user A 1104, whichmay include image scene 1108 recorded in image 1106. Utilizinginformation for past used effects, past media data recorded witheffects, image scene 1108, using information for user A 1104, and/orlocation data for image scene 1108 and/or image 1106, one or morerecommendations may be determined and output through interface 1100.

For example, platform X 1102 may allow for editing of image 1106 with aneffect 1110 a, an effect 1110 b, an effect 1110 c, and/or an effect 1110d. Effects 1110 a-d may each correspond to a post-processing edit effectthat can be added to image 1106 to alter an output of image 1106, forexample, by adding or blending a graphic to image 1106, adjusting pixelvalues of image 1106, or otherwise editing image 1106. Each of effects1110 a-d are shown with a corresponding recommendation, where multiplerecommendations are determined for use of effects 1008 a-d based ondifferent parameters, ratings, and/or past use information of effects1008 a-d. For example, a message 1112 a displays that effect 1110 a is“used by 1500 people!” Message 1112 a therefore indicates effect 1110 ais a popular or trending effect. Similarly, a message 1112 b displays“Alice B uses!” for effect 1110 b, where Alice B may be a popular orcelebrity user, or other trendsetter that uses media editing effects.Alice B may also be followed by user A 1104 and indicated as a personthat user A 1104 requests tips for use of effects. Conversely, effect1110 c is shown as a new, not recently used, or unique message when amessage 1112c displays that effect 1110 c is “Unused!” Thus, effect 1110c may be of interest to a user wishing to utilize new, not recentlyused, or unique effects. Finally, a message 1112d may be used to showthat effect 1110 d may make a portfolio of images coherent and similarby displaying that effect 1110 d is “used in past 15 images!” Thus, theuser may view an effect that the user commonly uses. Interface 1100 mayalso display a media library 1114 for output of image 1106 in interface1100, where media library 1114 allows a user to browse and select mediafor editing. Additionally, interface 1100 may include a search field1116 to allow a user to search for media, effects, or other availableservice on platform X 1102.

FIG. 3 is an exemplary system environment of a communication deviceinteracting with a service provider server to determine and outputrecommendations during image capture and post-image processing,according to an embodiment. Environment 300 of FIG. 3 includescommunication device 110 discussed in reference to system 100 of FIG. 1.

Communication device 110 in environment 300 executes image processingapplication 130 corresponding generally to the specialized hardwareand/or software modules and processes described in reference to FIG. 1.In this regard, image processing application 130 includes data used tocapture media content and/or edit media content, including addingeffects to media content as the media content is recorded and/or editingrecorded media content to include one or more effects. Image processingapplication 130 therefore includes captured media 2000, which mayinclude media A 2002. Media A 2002 may be for a scene A 2004, such as areal-world physical scene that includes objects, users, or other items.Thus, scene A 2004 may correspond to recorded electromagnetic radiationfrom a scene that is detected by a camera and recorded usingphotosensitive film or an array of photo sensors. Media A 2002 may alsobe associated with a location 2006, such as GPS coordinates or otherlocation data. Captured media 2000 in image processing application 130may also utilize recommended data 2008 for use with media A 2002, whichmay include an effect 2010 recommended for media A 2002. Effect 2010 mayprovide an effect during recording of media A 2002 and/or apost-processing effect after recording.

Recommended data 2008 may include other recommendations, including acapture scene 2012 providing directions for how or where to use thecamera to capture media A 2002, including positioning, direction,inclusion or removal of certain objects/users, etc. Recommended data2008 may further include a hashtag 2014 for uploading and posting ofmedia A 2002. In various embodiments, captured media 2000 may beassociated with viewfinder output 2016, which may provide recommendeddata 2008 with media A 2002 in a viewfinder display to notify a user ofrecommended data 2008 for use with media A 2002. In order to determinedrecommended data 2008, image processing application may also access,use, and/or determine user information 2018, which may include pastmedia 2020 captured by the user, such as a user A library 2022, as wellas user A media sharing information 2024 for connections with otherusers that may influence recommended data 2008. User information 2018may further include location 2006 for the user at the time of capture ofmedia A 2002.

Service provider server 140 in environment 300 executes image sharingapplication 142 corresponding generally to the specialized hardwareand/or software modules and processes described in reference to FIG. 1.In this regard, image sharing application 142 includes uploaded and/orstored media content that may be altered with a media effect, forexample, by communication device 110 and/or using a platform provided byimage sharing application 142. Image sharing application 142 includesmedia libraries 2100 for stored media data. Media libraries 2100 may beused to store edited media content having one or more effects, determinerecommendations for media effects for other media content, and/or accessand edit stored media content. Thus, media libraries 2100 includes userA library 2022, which may be shared with image processing application130 of communication device 110. User A library 2022 includes media2102, effect usage 2104, experience information 2106, and trend rating2108. Each of media 2102, effect usage 2104, experience information2106, and trend rating 2108 may be used to determine recommendations forthe user associated with user A library 2022 and/or other users.

Additionally, image sharing application 142 includes media sharinginformation 2110, which may include data used to determinerecommendations for media processing effects based on processedinformation for popularity, usage, and/or trendiness of media effects.For example, media sharing information 2110 includes media viewingstatistics 2112, which may include statistics for scenes 2114 capturedin media content, users 2116 sharing the media content, effects 2118used in the captured media content, hashtags 2120 used to post mediacontent on a platform associated with image sharing application 142,and/or views 2122 of the media content. Utilizing the aforementionedinformation accessed by image sharing application 142, recommendations2124 may be determined, which may include recommended data 2008 for userA 2126 associated with communication device 110 recording media A 2002and having user information 2018.

FIG. 4 is a flowchart of an exemplary process for digital imagefiltering and post-capture processing using user specific data,according to an embodiment. Note that one or more steps, processes, andmethods described herein of flowchart 400 may be omitted, performed in adifferent sequence, or combined as desired or appropriate.

At step 402 of flowchart 400, image capture data corresponding to afirst image of a scene is received from a camera having an image sensor.Image effect data for a first past image associated with the scene isreceived, wherein the image effect data comprises information associatedwith a previously used image effect on the first past image, at step 404of flowchart 400. The information may comprise one of a popularityrating of the previously used image effect, a number of uses of thepreviously used image effect, a location-specific use of the previouslyused image effect associated with a location for the scene, or atrending rating of the previously used image effect. The image effectdata may further be for a plurality of past images associated with thescene including the first past image and using the previously used imageeffect, wherein the image effect data is crowd-sourced from a pluralityof users capturing the plurality of past images. The image effect datamay be received using one of a location of the mobile device system whenrecording the first image of the scene, a local wireless connection bythe mobile device system with another device, or social networkingconnections of a user associated with the mobile device system on asocial networking platform. The first past image may also be recorded bythe device associated with the image capture data and stored by thedevice to a library of images, wherein the recommended image effectcomprises the previously used image effect in the first past image. Inthis regard, a second image may be used to determine the recommendedimage effect, such as a second image having the effect. The recommendedimage effect may also be determined using user information for a userassociated with the device recording the media capture data and/or inthe media capture data, such as a representation or portrayal of theuser in the media capture data.

The camera of the device may include an image sensors, where the imagesensor comprises an array of light detectors. In such embodiments, therecommended image effect comprises a filter applied post-processing ofdigital image data for the first image generated using the array oflight detectors. For example, the recommended media effect may comprisea software routine that alters the appearance of the real-world scene inthe media data. The recommended image effect may also correspond to alens used with the camera of the device associated with the imagecapture data. The recommended image effect may also include an audioinstruction for using the camera to capture the media capture data,which may be output using an audio output component. The recommendedmedia effect may also blur a portion of a real-world scene in the mediacapture data based on past images captured of the real-world scene.

At step 406 of flowchart 400, a recommended image effect for the firstimage is determined based on the image capture data and the image effectdata. The recommended image effect may comprise one of an image colorfilter that applies an adjustment to pixels of the first image or astored graphical image blended with the first image. In variousembodiments, the device having the image capture data may store a firsteffect and a second effect that change an appearance of one or moreimages including the first image, wherein the recommended image effectrecommends the first effect over the second effect based on usage of oneof the first effect or the second effect with the first past image. Insuch embodiments, the recommended image effect may be limited to thoseeffects available to the device, such as the first and second effect.

The recommended image effect is output using an output component of themobile device system, at step 408 of flowchart 400. The output componentmay comprise a display screen of the mobile device system, and thedisplay screen may display a viewfinder interface that comprises theimage capture data, as well as a recommendation notification of therecommended image effect. In certain embodiments, the information usedto determine the recommended image effect may further comprise apreviously used hashtag identifier used with the first past image,wherein the recommendation notification further comprises a hashtagidentifier recommendation for posting the first image on an imagesharing platform based on the previously used hastag identifier.

FIG. 5 is a block diagram of a computer system suitable for implementingone or more components in FIG. 1, according to an embodiment. In variousembodiments, the communication device may comprise a personal computingdevice (e.g., smart phone, a computing tablet, a personal computer,laptop, a wearable computing device such as glasses or a watch,Bluetooth device, key FOB, badge, etc.) capable of communicating withthe network. The service provider may utilize a network computing device(e.g., a network server) capable of communicating with the network. Itshould be appreciated that each of the devices utilized by users andservice providers may be implemented as computer system 500 in a manneras follows.

Computer system 500 includes a bus 502 or other communication mechanismfor communicating information data, signals, and information betweenvarious components of computer system 500. Components include aninput/output (I/O) component 504 that processes a user action, such asselecting keys from a keypad/keyboard, selecting one or more buttons,image, or links, and/or moving one or more images, etc., and sends acorresponding signal to bus 502. I/O component 504 may also include anoutput component, such as a display 511 and a cursor control 513 (suchas a keyboard, keypad, mouse, etc.). An optional audio input/outputcomponent 505 may also be included to allow a user to use voice forinputting information by converting audio signals. Audio I/O component505 may allow the user to hear audio. A transceiver or network interface506 transmits and receives signals between computer system 500 and otherdevices, such as another communication device, service device, or aservice provider server via network 150. In one embodiment, thetransmission is wireless, although other transmission mediums andmethods may also be suitable. One or more processors 512, which can be amicro-controller, digital signal processor (DSP), or other processingcomponent, processes these various signals, such as for display oncomputer system 500 or transmission to other devices via a communicationlink 518. Processor(s) 512 may also control transmission of information,such as cookies or IP addresses, to other devices.

Components of computer system 500 also include a system memory component514 (e.g., RAM), a static storage component 516 (e.g., ROM), and/or adisk drive 517. Computer system 500 performs specific operations byprocessor(s) 512 and other components by executing one or more sequencesof instructions contained in system memory component 514. Logic may beencoded in a computer readable medium, which may refer to any mediumthat participates in providing instructions to processor(s) 512 forexecution. Such a medium may take many forms, including but not limitedto, non-volatile media, volatile media, and transmission media. Invarious embodiments, non-volatile media includes optical or magneticdisks, volatile media includes dynamic memory, such as system memorycomponent 514, and transmission media includes coaxial cables, copperwire, and fiber optics, including wires that comprise bus 502. In oneembodiment, the logic is encoded in non-transitory computer readablemedium. In one example, transmission media may take the form of acousticor light waves, such as those generated during radio wave, optical, andinfrared data communications.

Some common forms of computer readable media includes, for example,floppy disk, flexible disk, hard disk, magnetic tape, any other magneticmedium, CD-ROM, any other optical medium, punch cards, paper tape, anyother physical medium with patterns of holes, RAM, PROM, EEPROM,FLASH-EEPROM, any other memory chip or cartridge, or any other mediumfrom which a computer is adapted to read.

In various embodiments of the present disclosure, execution ofinstruction sequences to practice the present disclosure may beperformed by computer system 500. In various other embodiments of thepresent disclosure, a plurality of computer systems 500 coupled bycommunication link 518 to the network (e.g., such as a LAN, WLAN, PTSN,and/or various other wired or wireless networks, includingtelecommunications, mobile, and cellular phone networks) may performinstruction sequences to practice the present disclosure in coordinationwith one another.

Where applicable, various embodiments provided by the present disclosuremay be implemented using hardware, software, or combinations of hardwareand software. Also, where applicable, the various hardware componentsand/or software components set forth herein may be combined intocomposite components comprising software, hardware, and/or both withoutdeparting from the spirit of the present disclosure. Where applicable,the various hardware components and/or software components set forthherein may be separated into sub-components comprising software,hardware, or both without departing from the scope of the presentdisclosure. In addition, where applicable, it is contemplated thatsoftware components may be implemented as hardware components andvice-versa.

Software, in accordance with the present disclosure, such as programcode and/or data, may be stored on one or more computer readablemediums. It is also contemplated that software identified herein may beimplemented using one or more general purpose or specific purposecomputers and/or computer systems, networked and/or otherwise. Whereapplicable, the ordering of various steps described herein may bechanged, combined into composite steps, and/or separated into sub-stepsto provide features described herein.

The foregoing disclosure is not intended to limit the present disclosureto the precise forms or particular fields of use disclosed. As such, itis contemplated that various alternate embodiments and/or modificationsto the present disclosure, whether explicitly described or impliedherein, are possible in light of the disclosure. Having thus describedembodiments of the present disclosure, persons of ordinary skill in theart will recognize that changes may be made in form and detail withoutdeparting from the scope of the present disclosure. Thus, the presentdisclosure is limited only by the claims.

What is claimed is:
 1. A mobile device system comprising: a cameraconfigured to record a first image of a scene using an image sensor ofthe camera; a non-transitory memory; and one or more hardware processorscoupled to the non-transitory memory and configured to read instructionsfrom the non-transitory memory to cause the mobile device system toperform operations comprising: receiving, from the camera, image capturedata corresponding to the first image of the scene; receiving imageeffect data for a first past image associated with the scene, whereinthe image effect data comprises information associated with a previouslyused image effect on the first past image; determining a recommendedimage effect for the first image based on the image capture data and theimage effect data; and outputting the recommended image effect using anoutput component of the mobile device system.
 2. The mobile devicesystem of claim 1, wherein the information comprises one of a popularityrating of the previously used image effect, a number of uses of thepreviously used image effect, a location-specific use of the previouslyused image effect associated with a location for the scene, or atrending rating of the previously used image effect.
 3. The mobiledevice system of claim 1, what the recommended image effect comprisesone of an image color filter that applies an adjustment to pixels of thefirst image or a stored graphical image blended with the first image. 4.The mobile device system of claim 1, wherein the output componentcomprises a display screen of the mobile device system, and wherein theoperations further comprise: displaying, using the display screen, aviewfinder interface that comprises the image capture data, wherein theoutputting the recommended image effect comprises: displaying arecommendation notification of the recommended image effect in theviewfinder interface.
 5. The mobile device system of claim 4, whereinthe information further comprises a previously used hashtag identifierused with the first past image, and wherein the recommendationnotification further comprises a hashtag identifier recommendation forposting the first image on an image sharing platform based on thepreviously used hastag identifier.
 6. The mobile device system of claim1, wherein the operations further comprise accessing a first effect anda second effect that change an appearance of one or more imagesincluding the first image, and wherein the recommended image effectrecommends the first effect over the second effect based on usage of oneof the first effect or the second effect with the first past image. 7.The mobile device system of claim 1, wherein the image effect data isfurther for a plurality of past images associated with the sceneincluding the first past image and using the previously used imageeffect, and wherein the image effect data is crowd-sourced from aplurality of users capturing the plurality of past images.
 8. The mobiledevice system of claim 1, wherein the image effect data is receivedusing one of a location of the mobile device system when recording thefirst image of the scene, a local wireless connection by the mobiledevice system with another device, or social networking connections of auser associated with the mobile device system on a social networkingplatform.
 9. The mobile device system of claim 1, wherein the first pastimage is recorded by the mobile device system and stored by the mobiledevice system to a library of images, and wherein the recommended imageeffect comprises the previously used image effect in the first pastimage.
 10. The mobile device system of claim 1, wherein the operationsfurther comprise: accessing user information for a user associated withthe mobile device system, wherein the recommended image effect isfurther determined based on the user information.
 11. The mobile devicesystem of claim 1, wherein the output component comprises an audiooutput component, and wherein the recommended image effect comprisesaudio instructions for using the camera to record the first image. 12.The mobile device system of claim 1, wherein the operations furthercomprise: receiving a second image of the scene, wherein the recommendedimage effect is further determined using the second image.
 13. Themobile device system of claim 1, wherein the image sensor comprises anarray of light detectors, and wherein the recommended image effectcomprises a filter applied post-processing of digital image data for thefirst image generated using the array of light detectors.
 14. A methodcomprising: receiving media data captured of a real-world scene from acamera of a device; determining media effects applied to other mediaassociated with the real-world scene, wherein the media effects altervisual presentation of the media data; determining a first media effectrecommended for application to the media data based on the media effectsapplied to the other media; and causing the first media effect to bedisplayed with the media data by the device.
 15. The method of claim 14,wherein the first media effect comprises a software routine that altersthe appearance of the real-world scene in the media data.
 16. The methodof claim 14, wherein the first media effect is further determined usingpast images captured of the real-world scene, and wherein the causingthe first media effect to be displayed with the media data comprises:blurring a portion of the real-world scene in the media data based onthe past images.
 17. The method of claim 14, wherein the other mediacomprises one of first media captured of the real-world scene, secondmedia of other real-world scenes related to the real-world scene, thirdmedia sharing a same hashtag identifier with the media data on a mediasharing platform, or fourth media in a media portfolio of a userassociated with the device
 18. The method of claim 14, wherein the mediadata comprises one of a video or an image, and wherein the first mediaeffect comprises one of a lighting filter applied to the one of thevideo or the image or an overlay graphic in the image or video of thereal-world scene.
 19. A non-transitory machine-readable medium havingstored thereon machine-readable instructions executable to cause amachine to perform operations comprising: receiving, from cameraassociated with a device of a user, image data for an image of a scene;determining an imaging filter applied to at least one other imageassociated with the scene by at least one other user; accessing userinformation for the user; determining a recommendation for the imagingfilter based on the user information; and displaying the recommendationto the user using the device.
 20. The non-transitory machine-readablemedium of claim 19, wherein the device includes a viewfinder for thecamera, and wherein the imaging filter comprises an optical lens of thecamera.